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ease of entry, identified the VoSt preferred example, and answere^d 
other quiBstions rega'rding.^gs ign preference. Findings indicate the 
preferred instrument format^would include: dashes or blanks with no 
embedded per iods (continuous lin'es) for numeric 6r doll'ar amounts; 
vertical listing bf response, options for individual multiple choice 
items with a blank beside each option to be^ checked and* the card 
column indicators in the- margin; columnar lijstings of numeric codes 
to be circlecj and response labels at column neads for multiple choice 
items with the same response jppt ions ; anc3 card column indicators 
placed in the right margin. Instrument design tttilizing thes« 
preferred elements should be consistent in response format and in. 
card column indicator placement. Format preferience does not> insure 
the fastest or most accurate entry, but should be one'of several 
inst rumenls^esign considejrations . The questionnaire used for this 
study is ap]^nded. (BS) " ' ^ 
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When large numbers of subjects are used in a research prqject, thf^'data 
are frequently- ^lyzed by computer. Many researchers collect the data, then 
trangfer the d^ta to coding sheets before entry into the computer. Record- 
ing the data onto the coding sheets can take approximately as long as the 
actual^'data^ entry and, in addition, introduces another possible source of 
error. In many instances- it is pdasible to J^oi-mat the ^ta . col lection instru- 
ment s:o 'that, the data can be entered directly from that instrument Vithout 
hav4^g Co jjs^e cpding jsheetsl . 

• ^ ' " - ■'■ ■ ' ' ■ 

^ ; Thpre^are a variety of ways in which .instruments can be formatted for 

.,(5ompute^ d^ta entry." The appearance pi thp instrument mayTbe. veoy .impor^nt 

".."-H." ' " - ,.■ " ' ■' ".( , " - > 

""^il questionnaif-e to be filled out drjd.Yet'ur^n^^d '^t^^" th^. will of?- 

the- respomdent .-. In '.that case formatting th-^ instrum^n-V f^j'r .d'ata^'ek'tVy^is V 

■.ft • • ' -i. ■^■» ff>t ,' ^ ■ ' 

pi^obably of. secondary importance, because if th^ qCTesti-onti'M f es . a*i*i^ h^t.Ve-"" 

tuliied: there ;3re no ,data-.to enter. Irj other instanc^9s:,^^5uti^'as ph^SVte-o^ per- 

spiral irfterv^ew surveys, the app^arancd -of the in a^jyunfen t* i's\bf 'leased- impor- 

* '1 ' > ■ '\ >v 

tance. The .potent ial cj istraction of c^rd colump ina-ic«t;or4 i^WVe^f'oifscf^w^es 
have^ ^° "^'^'^ whether or not the re spondent ' Chooses tQ,' ansKer, the 

questions since the interviewer records the responses and the responden,^^ mgy 
never actually see the instrument- . ' ^ ; , 

While rhere are different ways of formatting the same type of item, it ' " 
may be that one or more ways are preferred by those, who actually enter the 

data. This investigation was undertaken to examine the preferences ' of data 

■ . . ^ . 

entry personnel with regard to four situations: numeric response items in- 
dividual multiple choice items, multiple choice iten\s in which there are sev- 
eral items with the same response options, and card column indicator placej- 
ment. Some of the more common examples have been used due to the difficulty 
of including all possible examples for each of t^he four design elements. '» 



. It is acknowledged that thefle are not the oijly types of Items or format con- 
sideratlons and tliat any results obtained pertain only to the type included 
in this reseaVch. 

t 

Metliod 

Subjects 

yTh^ subjects were 13 females comprising the Data Entry. staff at a major 
University. One individual was the manager, while the other 12 were profes- 
sional 'data entry employees. They had been employed in data entry for from 
three to twenty-one- years, with three employees having twenty or more years 
of experience- The average was 12 years. 

The Data Entry office is primarily responsible for- entry of data for' , 
administrative purposes at the institutional level. When time permits, 'data 

*■ - k 

entry assignments from other individyals and groups within the university 
setting are alsfo accepted. Data can be entered directly from data collection 
instruments when, prc5iperly formatted-^ ^ 



V 

Instrument' = " 



• Ease of En try > 'A data collectl'on' instrument was designed to determine 

the ease of entr^r Of various type.s o|/fl^rmars for numeric response items, ' ' 
individual -multiple choia^ ftems, sets of rtiul tiple choice items, having 
t;h?.same r^^sponse options,^an4 card'<:olumn indicators. Several format options 
were selected for each of the four ar*eas*bein^ investigated leased iSn s var'i- 

r * ' » 

^Gty« of actual instruments and examples of instruments foisind in "resource and 
textbooks, The numeric response section contained five examples; th^ indi- 
vidual multiple choice * section had ten items; the sets of multiple choice - 



items consisted of eight formats f and the card column Indicator placement 
section irTcluded f our. e^mples, ) 

Beside each example, the subject rated the format on the following basis 
1. Very Difficult;. 2. Difficult; 3. Not Sure; 4. Easy; or 5. Very Easy. The 
subject was directed to consider the ease or difficulty of entering an entire 
survey or questionnaire formatted like the example. 

Preferences and Forced Choice . At the end of each of the fo'urVsections, 
the respondents were asked to igfentify the example they would most prefer 
from among those presented. In addition, multiple choice questions were in- 
cluded at the ends- of three sections in an attempt to pinpoint specific desigr 
,1 ■ * 

preferences. ^ ^ 

The final p^age of the instrument -elicited the number of years of ^experi- 
once 1%^ the respondent, the most troublesome type of format or survey struc- 
ture for them t;o enter, and their opinions regarding the difficulty of left- ■ 
hand stapling when card column indicators (and answer blanks) were along the 
left-hand side of the page. ^ 

Results 

Numeric 

Ease of Entry . For numeric responses, the example showing answer blanks 

\ 

or ti^es vertically aligned along the ri^ht^side -of the page (example B) wa,s 
easiest to enter as shown by the highest rating mean (4.33). (See Section 
I.) This was the only example which was not markedjby a single respondent 
as either Difficult or Very Difficult. 

Preferences, Forced Choice . At the end of that section only four respon- 
dents designated k preference for any numeric response format shown, and each 
of those four selected a different fonnat. When forced to consider, specific 



elements In .the foroiat^ through the multiple choice i terns , the largest nuni- 
ber6 of data*^ entry personnel preferred lines (n=8), no periods (n=7), and 
aligning answers along the right side of the page (n=8). 
Individual Mul triple Choice 

Ease of Entry.. , The individual multiple choice format with the highest 
overall mean was example B, which showed choices aligned vertically along the 
left side of the paper beneath the item^ with the answer blank and answer 
code (in parentheses) to Che left of the response option. (3*ee Section II.) 
Examples B and E (which are identical except fof the use of parentheses) were 
rated either Easy or Very Easy by all respondents- The two examples with 
the lowest means (examples I ^and J) were the only two with a blank in which 
to write the number of the answer rather than having the respondent check 
beside or circle the an^swer. * ♦ C * 

Preferences, Forced Choice . Only three respondents identified a preferred 
example for Individual Multiple Choice items. Dashes (fill in the code, as 
in examples I and J), da-shes (check one) and blocks were nearly equally pre- 
ferred on the first forced-choice item at the bottom of the page. Placing 

t\\e number beside the answer (and next to the line (example B), and vertical 

/ 

listing of answei-s (examples A, B, and E) were preferred by seven of the eleven 
completing items 2 and 3- 
Several Multiple Choice Items 

Ease of Entry . When several multiple choice items with the same response 
options Vere presented, examples A and B were perceived as being the easiest 
to enter as indicated by means of^4.23 and 4.00 respectively. (See Section 
III,) Both have response options presented in columns with the response label 
at the top of eath column and a specific number code to be circled or^^a blank 
to be checked. Example F, which 'had the thtrd highest mean, also has' the re- 



sponse options in an arrangement similar to columns 



/ 



Column arrangemenL with answer cues (example II) was seen as most diffi- , 
cult to enter (x = 2,33).. Example C (x = 2.54) was the only other example 
in the entire instrument )^ith a mean below 3.00. Both H and C placed number 
codes only at the tops of the columns, and in example C there was no structured 
method of lining up answers vith items hor.lzontally . 

Preferences . Preferences were expressed for only four of- the examples. 
Example A was the preference of five respondents, example G (which was ranked 
fifth with a')dhS?tn of 3.58) was preferred by four, while example F (ranked 



third) was .preferred by two and example B by one respondent. 

\ 

Card Column Indicator Placement 

— — • — . • , ^ 

Ease of Entry . Car5 column indicators placed beneath answer blanks (ex- 
ample C) or to the right of the answer blank along the right side of the page 
(example D) wete rated easiest to enter (x^ / 4.09; xj = 4.00). (See Section 

Preferences, Forced Choice . When asked to ind icate a *pref erence , respon- 
dqnts were fairly evenly divided with, three each citing examples B and D, 
two respondents each preferring A and Individual format elements of plac- 

ing card column indicators in the right margin (example D) and indi<:ators ^ 
beside the answer blank (example B and D) were each preferred by over half 
of those responding. 
General Format P rob 1 ems 

In response to the questiops on the last *t>age of the instrument, respon- 
dents most frequently cited answers which are scattered on the page as being 
the md^st troublesome type of format or survey structure for them to enter 
(n=4). Also listed as most^ troublesome by one respondent each were: when 
both sides of the page are used, whei^'preced^ing digits are not included, wh^n 
card column indicators are not close to the answer, use of answer blocks", 
and card column indicators with answer on the left. 



Discussion and Conclusions 

While the number of subjects was limited, those responding did comprise 
the entire group of data entry personnel at a major univevsity and were pro- 
fessionals in the field with years of experience. Their qualifications make 
them eminently qualified to provide the information sought in this study. 

Forced choice preferences supported the ease-of -eAt ry ratings for for- 
matting numeric re.sponse items with the use of lines with no periods (for 
dollar amounts) that are vertically aligned along the right side of the page. 

There was 'some consistentry but also some inconsistency ye^g^ardin^, individual 

\ ^ , . 

multiple choice item formats. The format rated easiest also contained pre- 

\ " ^ • . ^ , 

ferr:^d elements 6f dashes^ to be checked, numbers beside tlie 'answer options, 

and vertical listing of answer options. However, the response forpiat of dashes 

with the number code of the answer to be written in was preferred by the largest 

number of Respondents although the two examples (I and J) ^hich used this for- 

ma.t were tied in'the rankings as the most difficult. PlUaccment of the number 

f 

code following the item, use of parentheses, and circling the answer from 
a horizontal listing were preferred by only a ^single individual each ^and' are 
probably best avoided if possible. 

■ ' / 

For a group of multiple choice items with /the. same response options, the 
most preferred format and also the easiest one to enter utilized answer codes 
to be circled which are arranged in columns with each column appropriately 
labeled with the response option. Both of the highest ranked gl-oup multiple 
choice formats (A and^ B) can easily be adapted to the right-side alignment 
of card c^^lumn indicators which was preferred 'in the section on indicator 
placement,. Respondents did not like vertical listing of responses when there 
were several items with the same response options. The three examples that 



were ranked as\ost: difficult (H, C, and E) were preferred by none of the 
respondents and, again, should probably be avoided. 

While example C for card column indicator placemljl^t w^s rated easiest 
to enter, the individual elements in that example of having card column indi- 
cators embedded in the instrument (not aligned) and beneath the responses 
were preferred by only one or two individuals: The preferences for individ- 
ual design elements relating to card column indicator placement were for in- 
dicators to be placed in the right margin and beside the answer blank, both 
of which are illustrated in example D whose mean on ease of entry was very close 
to that of the first-ranked format. It is possible that in example C, the pref- 
erence was for indicators beneath the answer blanks because the answer blanks 
were not consistently placed on the pagp. \ 

In'summairy, the instrument format preferred by the data entry personnel 
would include: dashes or blanks with no embeded periods (continifous lines) 
for numeric o\ dollar amounts; vertical listing of response options for in- 

• t ^ 

dividual multiple choice items with a blank beside each option to be checked 
and the card column indicators placed in the-margin; columnar listing of nu- 
meric codes to be circled and response labels at the heads of the columns f- 
for multiple choice items ^in which there are several iteijs with th^ same re- 
sp^nse options; and ca'rd column indicators placed in the right margin. In- 
dividual design elements preferred must be blended into an overall instrument 
design that utilizes consistency in both the format for -responses and in place- 
ment of card column indicators. ^ 

'This study, is limited in that only bVief examples of different types" - 
of formats were used rather than complete instruments. If respondents had 
had complete instruments representing various ways of formatting, their responses 
might have differed ^rom those expressed' in this study. The use of complete 
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instruments was considered but abandoned because of the length of time involved 

on the part of the respondents. It is also possible that although the respon- 

dents expressed a preference for a particular type of format, there mieht have 
f 

been others more preferable x«/hich were not included among the choices. 

This study did not attempt to determine the relationships between for- 
mat" preference, speed, and accuracy of entry.' Respondent preference for 
a format does not ^.nsure that that is the format which would provide for fast- 
est or most accurate entry. In terms of cost effectiveness, these questions 
also need to be answered. In any instrument, a balance must be found between 
processing considerations and those affecting the confidence that can be placed 
in the accuracy of responses due to clarity of format and the return fate. 
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SECTION I 
NUMERIC RESPONSES 



o 



TO 



c 



How much does your household spend per week for food? $ 



How much does your household spend per week for gasol ine/ travel ? $ 
How much does your household spend per week for entertainment? $ 



B. How much does your household spend per week for food? 



\ 



C. 



How cjuch does your household spend per week for gasol ine/ 1 r^ivel ? $ 

How much does your household spend pqr week for entertainment? 

How much does your household spend per week for food? $ 

How much does your household spend per week for gasoline/travel? $ 

How much does your household spend per week for entertainment? $ 



(1) (0) (2) (8) (I) 

12 3^5 
(0) (0) (I) (6) (5) 



3.67 3 



(0) (2) ^ (1). (5) (A) 



How much , does your household spend per week for food? $fl 1 I 1 I . HZJ fH] 
How much does your household spend per week for gasfollne/travel? $ [ | [ | \ J | | J * 
much does your household spend per week for entertainment'? $[ZJ LJI Q - i I. iZl 



(2) (3) m (2) (3) 



How 



E. How much does your household spend per week for food? 

$ ^ 

How much does your household spend per week for gasoline/travel? 

$ 

How much does Wur household spend per week for entertainment? 



Which do you prefer? 



A, 1; 1; C, 1; D, 1 



Do you prefer: (check one In each group) 



1. 0 Lines 
1 Dashes 



3 Blocks 



J ^Period ( , ) 

2 Period { ) 



^Answer at end of question 

_B ^Answer along rlg]it side, of page 

_2 ^'Vnswer benea^^h Item, to left side 

of page 



1 



'..33 1 



3.92 2 



3.08 5 



1 ?. 3 ' 4 



(1) (0 (1) (9) (0) 3.50 I, 



ERIC 



\ 



11 



E. 



r 



SEGTION ri 



A. Age: (check one) 



18-29 ^ 

50 yeara and older 



□ 1 

□ 2 



B. Ajjc: 



(check one) 
_ (1) 18-29 
_ (2) 30-A9 

(3) 50' years and older 



) 

AgC; (check one) 
1 O 18-29 

Age: (check one) 

(1) 18-29 



2 □ 30-/*9 



(2) 30^A9 



Age: (check one) 

1. 18-29 ^ 

2. 30-A9 

3- 50 years and older 



Age: (check one) 

18-29 (1) 

30-A9 (2) 

50 years and older (3) 



Age: (check one) 



Age; (circle one) 
1, 18-29 



2. 30-A9 



3 f _] bO ycar« and older 



(3) 50 years and older 



18-29 
30-A9 

50 years and older 



( ) 1 
( ) 2 
( ) 3 



3. 50 years and older 



I. 



Age:* 
1 



(from list below) 



J. 



18-29 

2. .30-A9 

3. 50 year? and older 



Age (from list below) 

1. 18-29 



2. 30-A9 

3. 50 years and older 



u 



> C5 



13 

to 



c 



(0) (1) (2) (7) (2) 



3.83 6 



I 2 3 A 5 

(0) (0) (0) (9) (3) 

I 2 3 A 5 

(0.) (2) (1) (7) (2) 



(0) (0) (1) (8) (3) 



K 2 3 



(0) (0) (0) (11) 



(1) il) vC) (8) v2) 



I '^^2 3 A 



(0) (1) (1) (6) (/.) 



1 2 3^ A 



(0) (1) (0) (8) (3) 



(1) (2) (0) (6) (3) 



(1) (2) (0) (6) (3) 



A. 25 '1 



3.75 7.5 
(ti/^) 



A. 17 2 



A .08 A 
(tlc7 



3.75 ;.5 
i;|tle 



A .08 A 
(tie 



A . 08 A 
(tic 



3.67 9.5 
(£le 



3.67 9.5 
(tie 



Which of the examples above do you prefer? 

7 

Do you prefer: (check one in each group) 

I. 3 D ashes (check one) 

^ 3 Blocks 

1 c ircle, Che answer 

1 Parenthesis 



B, 1; C. 1; J, I 



_Number on other side of block/line (Ex. A) 
_Number beside the answer, next to line (Ex. 



1 ^Number after the item (Ex. F) 



it Daah (fill in th* number (I or J) 3- A H orizontal list of answers (C. D. H.) 
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SECTION III ^ 
irt. SEVERAL MUI.T-IP1.E CllOiriZ ITEMS WITH SAME RESPONSE OPTIONS. 



I: 



circle ony 

Organization an<l ^ilannlng 
Communication ^ 
Q(iallty of presentations 



Check one: 

Organization and planning 

Communication 

Quality of presentations 



Good Good Fair Poor 



I 2 3 r 

12 3 4 



rVery 
Good 



Good Fair Poor 
(4) 



•(1) ^ (J) 



Ha 30 ot Kntry 



O c\j 
5^ W 



to 



12 3 . 

4- ^ 

(0) (i) (0) (7) 



.5 
(5) 



4.23. i: 



12 3 4' 
(0). (0) '(1) (11) 



a5 
(1) 



4 , 00 2 



D. 



Check one: 

Organization and planning 

Communication 

Quality of presentations 



4f 



Check one: 

Organization and planning 

Communication 

Quality of presentations 



Very 

Good Good Fair Poor 
(1) (2) (3) (4) 



Very good 
Good 
Fair 
Poor 

Very good 
Good 
Fair 
Poor 

Very good 
Good 
Fair 
Poor 



en (1) 

S (2) 

CI (3) 

a (4) 

(1) 

H(2) 

^ (3) 



Q (1) 

3~I (2) 
& (3) 

r4> 



Circle one: 




1 
2 
3 


Very good 

Good 

Fatr 




Organization and planning 




4 


Poor 




1 


2 


3 


4 


Communlca t ion 


1 


" 2 


3 


4 


Quality of presentations 


1 


2 


3 


4 



1 2-3 A 5 
(2) (5) (3) (3) (0) 



2.5A 7. 



(1) (2) (1) (6) (3) 




12 3 4 5 
(1) (M (0) (5) (3) 



3.62 4 



3.38 6 
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SlftT (Continued) 



^1 



Check o^e: 

Organization and planning 

( )1. Very go^d 7)2. Gogd 
>C<ip#Jj[n 1 c a t;i on v 



J| ) r. 'Very good ) 2. Good 

Quality of presentations 

( ) 1. ^'ery good i ) 2. Good 



( ) 3. Fair 



( ) 3. Fair 



( ) 3. Fair 



( ) ^. Poor 



( ) ^. Poor 



( ) A, Poor 



Check one: 

Organization and planntng 

1. Very good 

2. Good 

3. Fair 

^. Poor 

Communication 

1. Very good 

2. Good 

3. Fair 

^4. Poor 



Quality of presentations 

1. Very good 

, 2. Goad 

3. Fair 

^. .Poor 



Veiry 





Good 


Good 


Fair 


Poor 




(1) 


(2) 


(3) 


W 


Circle one: 










Organization and planning 


VG ^ 


G 


F 


P 


Communication * 


VG 


G 


F 


P 


Quality of presentations 


VG 


G 


F 


P 



Fase of Entry 



—I 




D 






U 


o 


O 


D 




■— « 

U-i 










0) —1 




1.J 

O 


> Q 






1 


2 


3 



Li4 



UJ 



(0) (2) CO) (9) (1>. 



1 2 3 A 5 
(1) (2) (0) (7) (2) 



1 2 3 A 5 
(2) (75 (0) (3) (0) 



Which do you ptefer?_ 



A, 5; B, 1; F, 2; G, 4 



SECTION IV 
iJ, PLACEMI-NT Ol-'^CARD COLUMN T INDICATORS 



What did you do during sununcr vacation? (Mark as many as apply tro you) 



rested/tcaveled 
_worked at another job. 
^tau^ht summer school 
_took course**? 
_none of the above 



(ccl) 
(cc2) 
(cc3) 
(cc4) 
(cc5) 



Jf you were employed In another job, how many hours did you work per week? (ccb-J) 

\ 



WhAt did you do during summer vacation?" (Mark as many as apply to you) 



(ccl) 
(cc2) 
(cc3) 
(cc^) 
(cc5) 



^rested/traveled 
^worked at another Job 
^taught sujpner school 
_took courses 
none of the above 



) 



If you were employed in another job, how many hours did ^ou work per weekT 



(cc6-7) 



What did you do during summer vacation? (Mark as mafiy as apply to you) 
^ rejjted/traveled 



worked at another job 
taught summer school 

r 

took courses 

■J 

none of the above 



(ccl) 



(cc3) 



(cc^O 



If you were employed in another job, how many hours did you^work-per week? 



(cc6-7) 



0. What did you do during summer vacation? (Mark as many as apply to you) 



rested/traveled 
worked at an9ther job 
taught summer school 
took courses 
none of the above 



(ccl) 
(cc2) 
(cc3) 
(ccA) 
(cc5) 



If you were employed in another Job, how many hours did you work per week? 

o 

T 

1 (cc6-7) . 



F/J so o t Vn i ry 



1-1 

(y ft* 
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u :j 














>> 


>s 




Vi 


U 






<D 




ui 




2 ^ 




5 



(1) - (3) (1) (6) (0) 



1 



2 3 A 5 
(1) (3) (0) (4) (3) 



c 
a: 



3 . 09 /» 



3.45 3 



(0) (1) (0) (7) (3) 
) 



1 



( 



12 3/^5 
) (1) (2) (A) (A) 



A. 09 1 



A. 00 2 



-*l^lch of the examples do you prefer? 



*'o you prefer: (check one in each group) 

_ 2 cc In left margin (Ex. B) 

7 cc In right margin (Ex. D) 
_ 2 cc embedded in questionnaire (Ex. A,C) 



A, 2; B, 3; C. 2; D, 3 



2* 7 cc beside answer blank (Ex. 13, D) 
A cc beside response (Ex. A) 
1 ■ cc beneath response (Ek. C) 



ERLC 
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13 
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